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ABSTSAC? 

This manual presents procedures for systematic' * 
curriculum devel6pfient ".nd evaluation. The system evaluates five 
major components in the development of a curriculua: 1) objectives, 
2\ instructional materials, 3) teaching procedures, a) inservice 
education, and 5| evaluation. An overview of specific activities 
staqifed over a five year period is outlined for eacji component. 
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INTRODUCTION 

Changing needs, new legislation, and administrative 
emphases have lead to a reexamination of the various educa- 
tional undertakings conducted by DoDDS. The results of the 
reexamination of the education process and program activities 
have been incorporated in this manual. Some programs have 
been reaffirmed but need additional attention while others 
have been modified. 

The focus of this manual is on the processes and 
procedures necessary for systematic educational planning and 
development within DoDDS. An important and compelling 
reason for the curriculum development and planning strategy 
described in this publication is that it will improve educa- 
tional opportunities and influence the educational experiences 
offered to students. 

The charts provide a visual description of the curriculum 
planning process and procedures. 

Chart shows, the three curriculum subject areas selected 
for each school year starting with the 1980-81 school year 
and ending with the 1984-85 school year. The ci'cle will 
repeat every. 5 years. The cycling sequence is subject to 
annual review by the DoDDS Curriculum Development Committee 
(DoDDS CDC). The "Curriculum Development Process" -(Chart 2) 
is an organizational c^art showing the lines of communica- 
tion and coordination among the various components of DoDDS. 
Chart 3 shows the composition of the task groups and the 

4 



DoDDS CurricuLuia Development Conunittee. Representatives 
from each region serve on the task groups and the DoDDS CDC. 
The task groups and the CDC are chaired by the corresponding 
curriculum coordinator, branch chief, or division chief of 
the Education i^ivision of the Office of Dependents' Schools 
(ODS). 

An overview of specific activities and requirements for 
the curriculum development cycle is given in Chart 4. The 
sequence of , activities over a 5-year stage is outlined for 




cycle, the task group meets with the DoDDS CDC twice to 
present program and organizational recommendations. These 
recommendations* for substantial changes were first prepared 
during the pre-entry year. Preparations for the entry year 
or first year of the formal review process serve as a foun- 
dation for activities that will occur in subsequent years. 
The major categories that are to be addressed by each curric- 
ulum task group are organized and phased over the 5 -year per- 
iod. Because of this phasing, budget resources, administra- 
tive and logistical support, and personnel recruitment and 
staffing changes can be anticipated and planned for systemati- 
cally. 

8 
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The framework for curriculum study, presented by the 
DoDDS CDC, represents important statements of issues and 
concerns about curriculum planning, development, and eval- 
uation. The process and structure stated in this curriculum ^ 
publication highlight the direc^tions for a continuing pro- 
cess. It also outlines the responsibilities of those involved 
in the curriculum development process . 

This plan is viewed as part of an evolving process of 
curriculum review and development. The curriculum develop- 
ment process of the DoDDS has been and will , continue to be 
flexible in order to facilitate the implementation of innova- 
tive ideas, programs, and procedures based upon experience 
and evaluation results. 

The development of th?.s curriculum process is due to 
the foresight, diligence, and patience on the part of many 
dedicated educators within DoDDS. Their efforts are greatly 
appreciated. 



CHART 1 

FIVE-YEAR CURRICULUM DEVELOPMENT SEQUENCE 



SCHOOL YEAR* 


EDUCATIONAL 
CATEGORY 


iNTERDISCLIPLINARY RESPONSIBILITIES FOR 
INSTRUCTION AND SUPPORT SERVICES 


1980-81 


A. Health & Physical 
Education 

Social Studies 
Student Services 


Physical & Mental Health, Drug Education 

Multiethnic Education, Intercultural Education, Ethical 
Development 

Accessibility of Human and Material Resources, Dormitories 


1981^82 


A. Reading 

Career Awareness 
C. Computer Education 


Reading in the Content Areas 

Career Information in Content Areas 

Computer Assisted and Computer Directed Instruction 


1982-83 


A. Language Arts 

B. Special Education 

C. Career Exploration 


Oral Expression, Writing, English as a Second Language 
Handicapped, Gifted and Talented 
Exploring Careers in Content Areas 


1983-1984 


A. Science 

B. Arts & Humanities 

C* Vocational Education 


Environmental Education, Outdoor Education 
Aesthetics and Creativity in Content Areas 
Vocational Skill Development in Content Areas 


1984-85 


A. Foreign Languages 

B. Mathematics 
C- Media 


Host Nation Programs 
Metric Education 

Resource Teacher Utilization, Learning Resource Centers 



*The school year indicates the entry year or first year of the five-year sequence. 
SEQUENCE IS SUBJECT TO ANNUAL REVIEW BY DODDS CURRICULUM DEVELOPMENT COMMITTEE 
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CHART 1 

FIVE-YEAR CURRICULUM DEVELOPMENT SEQUENCE 
Chart 1 delineates 15 curriculum categories and important interdisciplinary 
responsibilities assigned to each. 

Foreign Languages and Med i a are two educatjonal categories undergoing review by task 
groups during the 1979-80 school year. Host nation programs form the interdisciplinary 
responsibilities for the foreign language review^ Resource teacher utilization is an 
i^iterdiscipl Inary responsibility of the media review. Learning resource centers (includes 
educational media centers) are the focus of the media review. 

The interdisciplinary column of Chart 1- deserves special note. Too frequently in the 
past^ educators have devr ted a major portion of their resources to development within 
specific disciplines, grades kindergarten through 12. Consequently, interdisciplinary 
concepts and processes experienced little or no attention. Fortunately, these voids are 
beginning to be filled. Some of these i<-12 interdisciplinary requirements are being met. 
Others will be more adequately resolved with increased attention given to areas such as 
compensatory education, English as a second language [ESL], and early childhood education 
[ECE]. 

Many of the instructional offerings and educ^itional services represented by most of the 
educational categories are well known. This is especially true of the categories designated 




as health and physical education, social studies, language arts, science, maihemat;cs, 
humanities, and foreign languages. Offerings and services represented by the remaining 
categories, however, are not as widely known. Major subcategcr ies for ea-h are listed 
be I ow : 

1. Student Services Cpupi I personnel services) 

a. Counseling, Dormi tory Counse I i ng 

b. Social Work and Family Services 

c. Psychological Services 

d. Nursery and Preschool Services 

2. Special Education 



a. 


Lear-'ing Disabilities 


b. 


Educable Mental Retardation 


c. 


Trainable Mental Retardation 


d. 


Deaf and Hard of Hearing 


e . 


Speech Therapy 


f . 


Physically Impaired and Multiply Handicapped 


g- 


Blind and Partially Sighted 


h. 


Gifted and Talented 
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5. Career Exploration 

a. Business Education 

b. Industrial Arts 

c. Home Economics 

d. Career Information 
^. Arts and Humanities 

a. Music 

b. Hu!iianiti&s 

c. Visual Arts 

d. Performing Arts 
5. Vocational Education 

a. Cooperative Work Experience 

b. Specific skill development areas such as cosmetology, automotive technology. 



welding, dental and medical technology, electrical and electronic technology/ 
and computer technology. 

i 

c. Junior ROTC I 
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CHART 2 

CURRICULUM DEVELOPMENT PROCESS 



PRINCIPAL 



7\ 



SCHOOL 
CDC 




REGIONAL 
DIRECTOR 



7^ 



REGIONAL 
CDC 



7% 



REGIONAL 
TASK GROUPS 




DIRECTOR 
DODDS 



Si 



DODDS 
CDC 



7^ 



ODS 
TASK 
GROUPS 



Staff lines 



I] Channels of communication and coordination. 
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CHART 2 

Curriculum development recommendations may be initiated at the schobl^ regional^ 
or ODS level. The information concerning the recommendations should be disseminated 
to all appropriate levels for consideration. All documents and procedures developed 
at the regional or ODS level will be reviewed as a draft or evaluated under pilot 
conditions by schools before final ization. This process will determine feasibility and 
-4nsur« acceptance before implementation. 
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CHART 3 

COMPOSITION OF DODDS CUSRICULUM DEVELOPMENT COMMITTEE AND THE DODOS TASK GROUPS 



REGIONAL EDUCATION 
* DIVISION 
(six regions starring 1 OCT. 79) 



CHIEF, EDUCATION 
DIVISION I 



REGIONAL COORDINATOR,, 
CATEGORY A 



DODDS CDC 

CHAIRPERSON 
AND ■ 
MEMBERS 



TASK GROUP A 



CHAIRPERSON 
AND 
MEMBERS 



OFFICE OF DEPENDENTS SCHOOLS 
EDUCATION DIVISION^ 




I CHIEF, EDUCATION 

DIVISION 
iCHIEF, CURRICULUM 
BRANCH 



(and, when required. 
Chief. Supplementary 
Services Branch) 



ODS COORD I NATOR 
CATEGORY A 



REGIONAL COORDINATOR,, 
CATEGORY B 



regional coordinator,, 
cate6ory C 





TASK GROUP B 

CHAIRPERSON 
AND 
MEMBERS 






TASK GROUP C 

CHAIRPERSON 
AND 
MEMBERS 





ODS COOftDf NATOR 
CATEGORY B - 



ODS COORDINATOR 
CATEGORY C 



ERIC 



CHIEF, EVALUATION, 
BRANCH 



EVALUATION TASK GROUP 



CHAIRPERSON 
AND 
MEMBERS 



chief, evaluation^ 
'branch 
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CHART 3 

COMPOSITION OF DODDS CURRICULUM DEVELOPMENT COMMITTEE AND THE DQDDS TASK GROUPS 

The DoDDS Curr culum Development Committee consists of the cl.iefs of the Education . 
Division in the regions and OOS plus the ODS chiefs of the Eviriuation end Curriculum 
branches. The committee is chaired by the Chief of the Education Division, ODS. (See 
Chart 5.) When required, because of the subject area under review, the ODS Supplementary 
Services Branch chief will serve as a member of the DoDDS CDC. Regional directors have 
the authority to make substitutions for representatives for their region. 

„. Each task group is composed of the coordinator from each region for the category 

being reviewed. The chairperson is the corresponding coordinator at the ODS level. 
(See Chart 3.) 

The task groups make recommendations to the DoDDS CDC for review and possib'e modi- 
fications. The CDC will coordinate with the ODS logistics, fiscal, and personnel divi- 
sion chiefs on recommendations as appropriate. The DoDDS CDC in turn will make recom- 
mendations to the Director, DoDDS, for approval or disapproval. Upon approval by the 
Director, DoDDS, the recommendations become policy. 
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DESCRIPTION OF CURRICULUM REVIEW TASKS 

The purpose of this section is to provide guidance for 
DoDDS pei;sonnel in accomplishing the tasks associated with 
the Five-Year curriculum Development Plan. 

Chart 4 outlines the various activities that occur 
during each of the 5 years of the cycle. The tasks or 
activities are divided into five general areas, as shown in 
the outline: 











1 


* 

r 



The pages immediately following expand upon the out- 
line. The text is arranged in a year-by-year format, with 
each of the five general areas discussed in terms of the 
first year activities, then proceeding to the activities 
associated with the following year. Reporting requirements 
are summarized in Chart 5, "Reports to the DODDS CDC Based 
on Five-Year Curriculum Development Plan." 



— o 
ERIC 



20 

15 



Three topics developed in the remainder of this docu- 
ment which require close coordination to ensure similarity 
with educational programs within the United States are as 
follows : 

1. Guidelines for Preparing General, Program, and 
Instructional Objectives 

2. Sample Letter; Invitation to Submit Textbooks and 
Related Materials for Formal Review 

3. Criteria for Selection or Development of Instruc- 
tional Texts and Materials 
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CHART 4 DS Manual 2000. 

DODDS FIVE-YEAR CURRICULUM DEVELOPMENT PLAN 
FIVE-YEAR SEQUENCE OF ACTIVITIES FOR EACH INSTRUCTIONAL (SUPPORT SERVICES) CATEGORY 



' WAR 1 ORJEaiVEs 


INSTRIH TJONAl AITEHNATIVKS 
iVUOi KlWKAl ) 


INMRIUTIONAI. MATFKUI.S 
(SrrrOKt MATKHJAIS) 


IN-Sr.RVIfT KhlTATlnN 


mUlAT!ON 1 


■ 


Note ub jcct lvc8 (fuiutioni*) 
which she uld h- n-vised, J*" 
It^ted nr atidvd As rPNiiJt ot 
the I'valudt lun pruKram. 

Develop, revlKv sNsti'mwidv 
BrOpe .tii<l »»v<lufnri' o! pro- 
gram, inuru^ t .»h^e»- 
tivCi; hv Ifvcl. 

Publiuh &epv4r.iitr list tit mlni- 

rinAllitf drat I oh)ei tives 
publ [cat Uxnu . 

Devolop, Tfvlsi" statement 
pruccsses or prut rdure»> whir^ 
tnterrelatt* turn l Inns, 
appropr iflit I* . 


Idfntifv vhiih pri>( esyes tpro- 

.it»- or ^hnll!d he i^mpltivid 

Ni»t»' Uu ni"i'<i for uniqtit> m^nriKc* 
mt>nt suppiTt ^itlvitlrh Implltfd hv 
.V.H h i.t th«' m.iti^rMK ondir ri'vlrw. 

Pr fprtt I- r e}( li<na 1 ,ind hi UUS reptir t 
.»l ri'« .imm»'nd<i! i»»nK. 


Survev Inadfqu.K ion and strength 
ttf l urt t>nt m.itt-t tal h 

Kst.ibllnh it*vi««w ^tlttrrla ond 
r ev tew pr lu edur »'k . 


Provide In-Servlre on oble< t Ivr 
(functi.->n) and ( RT writing, 
tormiil revl»*w, as required. 

Provide in-servl*.*' nn di-slftn, 
implemontat ion, and evwluatlnn 


Provide analvdla and inter- 
pret.itloti of worldwide 
evaluat ion. 

Conduct review of worldwide 
evaluat iun instruments. 


YEAR 

1 


Sittd publthht-rs topv nf tih|et- 
t t V4'H ( t unx t i or.s) . pr lor i t i«'s, 
rrviiw trltfria, and ti'Vii'W 
pr»H »'»Ju t es . 

Cvndtu t I(irm.)I ifVlfW. Itt 
r IK l«»ns , 

r»ihllsh l».»m)S Wstlny ot t-^- 
uential tvKts and tittipram 
matrrials fur pilot iinK* 

Ordi ( pi h-l miiffr i.iK. 


of pilot ptiu'.rams f\n(l materials 
for regltmal rrpresent.it I ve«, 
as requ i red . 


neslRn proiedures tor pilot- 
InR Instruct lonal mater ials. 

Srlett instrumentation for 
pl lot s. 

Monitor revision .if DoDDS 
lib loc t ives . 


YEAIT 

2 


Det^rmlnr «>xieni to whli K 
pilot materlfllK fa(*lMt<}tf 
•chleveroent o? l)o[)DS uh^vtt Uv^i 
<funr-t ions) . 


KJrniJtv proi »'hsfH prnirdures 
wttii h Are m.*st ^.Ul(fsstul in pro- 
(<r«ms bftng |>l)i)trd in t iTtns nl 
Iparnrr .■'hnrnrtrr iRt irr nnd trm*hl«ts 
St V J p«; . 

Nt^t «* pr f»i-i«>isew, (procedures) or con- 
tent wViJcti might r»'quire in-service 
»*dur^t 1 iin . 

Nott' ' .anaxetni'nt hupport .utivltiew 
eHsent 1h1 t'» pilot implement at ion. 

Pri-iiArt- r»'p.irt tt» D.wmS ( TM . 


Condut t Y<'^'^~^''"R pilulinR \A 
nvw mdterlalh in rejt?^;ft»*, 
funded hv headqu.ir t el^fi DoT>l>S . 

Puh 1 i ^h adopt <*d iuHt r US.' rlona 1 
materlaXii Ust as a DS Manual, 

IntortD publiHhers of pllut re- 
Hultb, plans hy region. 

DoliS n«'Kotlrtte levfl of in- 
servlte suppurt nnd price of 
mnterials with puhllnh«*rs. 


I'rovid*' In-Kvrviif fi^r pi-r- 
!«onnel iundottin>i. pil.it, as 
required . 

Provide in-si'rv It I- » a* Ion 
on the need to infuse Inttr- 
di&ilplinarv perspit t 1 v..s 
into dibtipiineN '-r support 
services, .ik required. 

provide ln-Hervl» *• edo» .»t iiin 
on CRT and evaluation dtvrl- 
optnent .ind validation, an 
r equi r ed . 


Monittu deveh»pn»ent of t^t 
spei n i< *it lottH 

rv.indutt impltrmentflt Ion evsl- 
uat ion of pi 1 ot H . 

Ilt.vrli^p h de» islon matrix fur 
uHlnR plltit resul t s. 

R*.pot I oti results <»f pilot test 
of new mater la 1 s . 


YEAR 

3 


Check objectlvrs (functions) 
for Appropriate iniluhii^n ».>t 
Interdiiiclpl Inary areas (rnio- 
aitaents), in regions. 


Devrlup or rt*viKf guides In- 
i.-(>rpordt inj( examples ot inatruc- 
t i(>nal altrrnat IviMi (alt ernat ives 
(/ilternat We procedure^) necessarv 
tij^jifhieve tihlectlves (functions) 
and hiRhliKhtlnR esRent iai support 
ac t iv 1 1 ien . 

ld^*ntlfy pr(>ceHt.e« whii h would 
fatllitate arhlevtnnent of inter^ 
dlbtiplinarv perspet tives. 

Arranf;i' for ln*!>ervi»t' <tr Irnt n t ion . 


PubHshfrs provide review 
materlalfi to schools, .t*. appli- 
cable. 

Schools make selections, if 
al t ernat ives prov ided . 

New texts and materlalb fund- 
ed hv headquarter b l>oDDS re- 
quiftitionrd bV regluns. 

Identify ttupplraent arv tnater- 
lalit as possible support ele- 
tDents to interdisciplinary 
aspei t s . 


Provide In-servu e euucat ion 
tor Implementation of tiew 
tnaterlals, ds required. 

Provldi* in-servite eduiation 
ot» the I'lidl UH4* t'l rf irHer- 
InM-ref eri'nrvd evahiat li>n 
program. 

Prepar*' ttpnrt to llnDDS Jjrt' 
about attlvltles wit} parti- 
cipant suiamarv evaluations. 


Monitor the designs fur im- 
plemetiting se loc ted cuf titular 
mater lal s. 

Mrnltor the expansion and 
[ d<*vrl opm<*nt of lest speciflfn- 
t ions and item pools. 

Normative evaluation of curri- 
culum guides. 

ANsist in preparation of iti- 
Hervlce education report. 






Note prnhlema in t h«* use of new 
msterialf* H *a^or changes In 
instructional or procedural 
alternatlvef*. 

Hfvlse guldft'K i>n the hAKls of 
feed bark ff»r uKf. 

rri'Hr<- report to t>oDnS rDf . 


Materials are implemented. 

Review and requisition basic 
materials necessary to sup- 
p<ir t in t ei d1 sc Ipl Inary 
perspect Ives. 

Prepar** report to DohDS CDC. 


Pruvide additional In-servii 
eduiat ioti for Ir pi ewi-nt *it l.m 
uf new tiutvrl.il . required. 
And guides. 


Monitor the implementation 
,it Sflpited instructional 
mat er la 1 5. 


YEAR 

5 


Rftvlew fccope and sequence re- 
qulr«nentfi for progratr, in- 
•tructlOTUll objectives, in 
regions. 

Review objective* in term* of 
aioi^uiw essentiality, in 
regions. 

Rsvtew statement of fuoctiont*. 
In rsglons, 

ReglonsI exchange of objec*- 
tlves. scope and sequence, ftnd 
■InlQtujs essential objectives. 


Korate <*nd revi«*w Huccesfiful 
Instructional or prtuedural alter- 
natives in the reRions'and U.S. 
schools. Prepare report of 
f indlngfi. 

Ntite prublettb in the use of new 
InBtrut t iufial alternat iv«& (alter- 
native procedwrea) designed to 
suppor t Interdlscipl Insry 
perapect ives. 


Continue imp 1 eaent at ion and pro- 
gran dev«>Iupinent . 

Implement us« of interdisci- 
plinary support materials. 


Ptuvide In-servh e rdot .it Inn 
tu par t u i p.int h ttf the nt-w 
development tytle as r*'quired. 


(onducl 5« int review of evalua- 
t I'ln attlvltles and results. 

Lond uc t imp 1 eoen t « t lo n 
evaluat ic.n. 

Develop reporting and dissemins" 
t ion pro( edurefi. 

Mnnltor Item and test develop- 
ment prot ess. 

Conduit evaluation -jrientwtiun 
for regional personnel. 

Develop recotwnendat ions f of pro- 
gram improvement based upon 
Worldwide evaluation program aud 
other evMluiit Ive sourtes. 
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DODDS CURRICULUM DEVELOPMENT CYCLE 

Objectives (Functions) 

Year One 
(Entry Year) 

Although the "first year" is the school year during 
which the formal review of the curriculum category begins, 
some preliminary work must start during the prior year (year 
five of the previous cycle ) . 

Early in year five of the previous cycle, prior to 
the September meeting, the ODS curriculum coordinator will 
provide specific guidelines for the regions to assure that 
objectives are compiled, revised, added, or deleted. These 
objectives are exchanged among the regions by mail during 
January. Based upon the exchange, further modification 
should occur in each region and the results handuarried by 
each regional coordinator to the September meeting. The 
first meeting at the ODS level occurs in September. 




The first task at the September meeting is to compile a 
single draft dociament of objecti\fes that reflect a system- 
wide point of view. This document will comprehensively 
define the curriculum category in terms of: 

General Objectives 
Program Objectives 

Instructional Objectives (representative samples) 

The second task is to develop or revise a s6ope and 
sequence document. The scope and sequence reflects the 
program objectives and instructional objectives by grade 
level . 

The third and final task is to publish a separate list 
of objectives that are considered to be those which students 
must achieve: In other words, "minimum essential" objec- 
tives . 

The three documents just described will be published in 
draft form by the ODS coordinator and sent to the regions 
after review 'jy the DoDDS CDC. The regional coordinators 
will assure that a broad-based regional review takes place. 
They will be prepared to present proposed revisions to the 
draft in a second meeting at the CDS. The meeting will be 
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held during the spring of the first year. The major part of 
the spring meeting is devoted to other aspects of the cycle, 
but the "objective review" is a vital part. 

Suinmary ; 

1. Prior year, early in year: Instructions from ODS 
to regions. 

2. January, prior to start of year one: Objectives 
exchcinged by mail among regions. 

3. Year one starts in September: Meeting of regions 

and DoDDS CDC: 

a. General Objectives 
Program Objectives 

Sample Instructional Objectives 

b. Scope and Sequence 

c. List of Minimum Essential Objectives 

i*. October through spring: Regional review of the 
products . 

5. Spring meeting: Meeting of DoDDS and regional 
coordinators . 

Product: Revised products from September meeting 
and copies of finished product for publication submitted to 
DoDDS CDC fox review and concurrence. 
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Year Two 

Objectives ; 

At this point in the cycle, pilot programs will have 
begun in the regions » Coordinators and teachers will have 
had some experience with the objectives that were developed 
during the first year. There are two tasks associated with 
objectives during the second year. 

The first task for coordinators is to continue working 
with teachers and evaluation personnel in the future develop- 
ment of instructional objectives, a task that was begun 
during the first year. The entire "objective package" 
should also be examined for adeqiiate coverage of all aspects 
of the discipline. 



The second task is to determine the extent to which 
pilot materials facilitate the achievement of the stated 
DoDDS objectives. This factor is critical in the evaluation 
of the pilot programs. The "objectives" section ^f the 
form, "Criteria for Evaluation of Essential Texts and 
Materials," which is used in the review of all basic instruc- 
tional materials should be discussed in relation to the 
subject matter. 
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Year Three 

Objectives : 

During the third year, the objectives that have been 
developed will have played a major role in the material 
review, the pilot program evaluation and material review, 
and the pilot program evaluation and material selection. 
They will also be the determining factor in the development 
of criterion-referenced testing (CRT) instruments. 



Yet another factor must be considered during this year 
of the cycle. To achieve the stated purposes and goals of 
the DoDDS system, the objectives of all curriculum cate- 
gories must reflect the interdisciplinary aspects of the 
curriculum. During this year, the objectives must be 
reviewed to assure that appropriate interdisciplinary learning 
is included. 
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Year Four 

Objectives : 

The worldwide CRT program is emphasized during this 
year. The objectives package, of course, is the basis of 
these tests. 

No further refinement of the objectives is required during 
year four. 



YEAR 



4 
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Ob j ectives ( Functions ) 



Year Five 



(Pre-entry Year) 



Objectives : 

The final year of the cycle is a preparation year for 
the first year of the new cycle. By this time, new programs 
will have been implemented and evaluated. A host of data 
will be available to assist in the review of the objectives. 

Early in the school year, the ODS curriculum coordinator 
will provide specific guidelines regarding the revision of 
the entire objectives package. The scope and sequence, the 
program and instructional objectives, and the list of mini- 
mum essential objectives will be reviewed in each region. 
Each region will share with other regions proposed revisions 
during January. The results of the regional reviews will be 
presented by the regional representatives at the first ^ 
meeting of the new review cycle. 



ERIC 





Groups working at the ODS level must accomplish the following: 

1. Examine all objectives submitted by the region^. 

2. Discard duplicate objectives. ^ 

3. Correct errors, in classification of 0)3 jectives. 

4. Edit remaining objectives for consistency of 
expression. 

5. Assure that all elements of the curriculum category 
are represented by the objectives. 

6. Assure that higher levels of learning are indi- 
cated in appropriate objectives. 
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GUIDELINES FOR THE PREPARATION OF 
GENERAL, PROGRAM, AND INSTRUCTIONAL OBJECTIVES 

Clear and concise objectives serve a nxunber of pur- 
poses. Their primary function is to indicate the student 
performance that is desired as a result of instruction. 
Their careful formulation permits greater precision in the 
selection of educational materials, learning experiences, 
and appropriate assessment devices. They provide direction 
for school staffs and clearly convey instructional intent to 
students. Educational objectives are indeed the foundation 
of any curriculum development system. 

During the past few years, a large number of DoDDS 
personnel, as well as community members and students, have 
worked to establish the theoretical and practical framework 
that is necessary to assure that a comprehensive curriculum 
is functioning in our schools. 

That framework i^ found in the DoDDS publication 
"Educational Philosophy Statement and General Objectives." 
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The publication must be used as the basic reference in 
preparing general, program, and instructional objectives for 
each curriculum category. The statements contained therein 
provide the "umbrella" under which all objectives must be 
placed. 

The framework may be considered in a hierarchical 
sense. At the top, and in the broadest terms, are state- 
ments of mission and of philosophy. Based on those state- 
ments, five purposes of our school system have been identi- 
fied. These 5 purposes are more specifically defined in 
terms of 10 goals: 



Purpose 
Personal Competency 

Social Competency 

Vocational Competency 
Environmental Competency 

Learning Competency 



Goa I s 

Mental Health 
Physical Health 
Aesthet i cs 

Ethi cs 

Social Interaction 

Career Education 

Manmade Environments 
Natural Environments 

Bas i c Ski I I s 
Learn i ng Skills 



t 
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Thus far, the hierarchy is specific to the school sys- 
tem as a whole, but not to a given curriculum category or 
discipline. 

More specific "General Objectives" are the next level 
in the hierarchy. These objectives are specific to a given 
curriculum category and must define completely that curric- 
ulum category. Each general objective must relate to one or 
more stated goals. 

Two more levels of objectives, "Program Objectives and 
Instructional Objectives," complete the set of objectives 
that are developed and coordinated systemwide. Enabling or 
enroute objectives are developed by indi\;idual teachers or 
schools. 

Program objectives define the program elements in 
specific terms. They identify discrete areas of learning 
within a discipline which must be addressed in the teaching- 
learning process. 
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Instructional objectives are stated in measurable 
terms. Each relates to a specific program objective and 
may be used to measure the degree to which a student has 
achieved the program objective. 
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The program objectives package in a given curriculum 
category is the criterion upon which program evaluation is 
based. When assessing a given educational program, the 
program objectives are the referent; hence, the term 
"Criterion-Referenced Testing." The CRT items will answer 
the question, "To what degree are the program objectives 
being achieved by students?" 



All general, program, and instructional objectives are 
classified according to one of three accepted taxonomies of 
learning: Cognitive, affective, and psychomotor skills. 



To provide a manageable system, the cognitive domain, as 
developed by Bloom, has been consolidated into two cate- 



gories: 
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Therefore, by definition, all DoDDS objectives are classi- 
fied according to one of four domains: (a) Knowledge, (b) 
Intellectual Processes, (c) Attitudes and Values (Affective), 
and (d) Psychomotor Skills. 

To assure that adequate communication occurs throughout 
the DoDDS system, some general rules must be followed during 
the process of developing objectives: 

r 

V 

General Objectives 

1. Limited number, but must adequately define the curri- 
culum category (discipline) 

2. Classified as one of the stated DoDDS purposes. (The 
complete set must address all five purposes.) 

3. Classified into one of the four learning domains. (The 
set must include all four domains.) 

Program Objectives 

1. Relate to a stated general objective. 

2. Define a program element in terms of student learning. 
The set must identify all elements of the curriculum category. 

3. Classified as one of the stated DoDDS purposes. 
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4. Classified as one of the four learning domains. 

5. Classified as applicable to one or more grade-level 
bands: K-3, 4-6, 7-9, and 10-12. 

Instructional Objectives 

1. Relate to a given program objective. 

2. Are stated in terms of observable student behavior. 

3. Are classified as one of the four learning domains. 

4. Should not be of a higher level than the program 
objective to which it relates. 

5. Are classified as applicable to one or more grade level 
bands: 4-6, 7-9, and 10-12. 

Functions 

The preceding narrative has described the development 
and use of the DoDDS objectives system. The system has one 
unique characteristic: Each statement is based upon student 
learning. Each objective must be preceded by the phrase, 
"As a result of instruction, the student will . ..." The 
system, therefore, places the emphasis totally on the impact 
of instruction in terms of student learning. 
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Another aspect of the educational procete^must, how- 
ever, be addressed. The professional staff in the DoDDS 
system is frequently involved in activities which are not 
directly instructional, but support student learning. These 
activities are most obvious when one exeuaines media services, 
PPS services, and special education. These staffs, while 
involved to a large extent iri teaching activities, neverthe- 
less, have important duties related to providing a service to 
other staff members, to students, and to the community. In 
other words, they have functions that are not related directly 
to instruction, but support student learning. 

In the DoDDS system, the term "objective" has been 
reserved for those statements specifically addressing student 
learning. The term "function" is reserved for those statements 
reflecting activities that pertain to providing a service. 
With this distinction, it becomes possible to keep the 
hierarchy of "objectives" intact and establish a parallel 
hierarchy of "function" that will allow statements, with 
varying degrees of specificity, to be written. The parallel 
strands, therefore, are: 
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INSTRUCTIONAL (PROCEDURAL) ALTERNATIVES 
Introduction 

instructional alternatives or procedural alternatives 
include teaching methods, classroom organization, the manage- 
ment aspects of an instructional program, and the management 
of the school resource functions that invo.lve placement and 
scheduling of students for instructional purposes. Some 
examples would be the use of individualized instructional 
materials and techniques, the interest cvMter approach, peer 
tutoring, the choice of placement for a handicapped student, 
such as mains tr earning, the use of small and large group 
instruction, and simulation of work-study arrangements. The 
task group should review and consider a wide range of instruc- 
tional and procedural alternatives. 
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Instructional (Procedural) Alternatives 



YEAR 



1 



Year One 
(Entry Year) 



1. The curriculum task group, in its first meeting, will 
identify successful instructional or procedural alternatives 
which should be reconunended for use. The reports prepared 
in the preyear will serve as a basis for formal review and 
assist in the formal material review process. The instruc- 
tional methods section of the form, "Criteria for Evaluation 
of Essential Texts and Materials," which is used in the 
review of all basic instructional materials, should be dis- 
cussed in relation to the subject matter. If instructional 
methods are significant to the teaching and learning of the 
subject matter, greater numerical weight should be given to 
this section of the form. 



2. The task group v/ill consolidate information on signifi- 
ccL.it instructional or procedural alternatives and prepare a 
written summarization of its recomjnendations for presen- 
tation to the DoDDS CDC. 



ERIC 
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Year Two 



1. Regional curriculxun specialists will publish letters and 
guidelines , for the installation of pilots in selected sites. 

2. Regional curriculum specialists will make appropriate 
arrangements for in-service at selected school pilot loca- 
tions . 



YEAR 



2 



3. Regional curriculum specialists will prepare written 
summarizations of significant program improvements, noting 
essential management support activities. Their summaries 
should be forwarded to the corresponding ODS curriculum 
specialist for transmittal to the DoDDS CDC by May of each 
year . 



ERIC 
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Year Three 



1. Regional curriculum specialists will publish letters, 
draft guidelines, and draft manuals concerning new adoptions, 
as required. Essential support activities needed should be 
highlighted. 



2. In-sein;'ice should be provided prior to the installation 
of new materials, as required. Regional curriculum special- 
ists will arrange for appropriate in-service orientations 
for teachers who will be using newly adopted materials in 
order to build an awareness of instructional or procedural 
alternatives . 

3. Regional curriculum specialists, through existing cur- 
riculum review processes, will identify regional instruc- 
tional priorities including processes which would facilitate 
achievement of interdisciplinary perspectives and formulate 
plans for improving existing practices. 



YEAR 



3 
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Year Four 

1. Regional curriculum specialists will publish priority 
interests in instructional and procedural alternatives which 
clearly indicate those practices which are considered to be 
highly desir^le and well suited to the achievement of 
instructional objectives. Problems should be noted that are 
related to the use of new materials, especially if a major 
change is required in instructional or procedural alternatives 

2. Regional curriculum specialists will make appropriate 
plans to complete in-service related to new adoptions of 
materials ^s well as orientations for interdisciplinary 
perspectives . 

3. Regional curriculum specialists will revise guides or 
manuals on the basis of feedback from use and finalize and 
publish them for distribution to school faculties. 



4. Regional curriculum specialists will prepare written 
summarizations of significant program improvements and accom- 
plishments. These reports should be forwarded to the corres- 
ponding ODS curriculum specialist for submission to the 
DoDDS CDC. 
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Instructional (Procedural) Alternatives 



Year Five 



(Pre-entry Year) 



1. Tasks during the year preceding the formal review should 
focus on locating and reviewing successful instructional or 
procedural alternatives. Instructional or procedural alter- 
natives reviewed should be those that are in use within the 
DoDDS as well as those found in the U.S. school systems. 

2. Written reports of the findings will be prepared which 
reflect student achievement, educational setting, teacher 
competency, community acceptance, and degree of compati- 
bility with DoDDS objectives. The regional curriculum 
specialists will present written reports to their respec- 
tive DoDDS curriculum specialists that summarize successful 
instructional or procedural alternatives in practice within 
their regions. The regional reports may be reviewed by the 
regional CDC. The ODS curriculum coordinator will prepare a 
report focusing on instructional or procedural alternatives 
that U.S. school systems find successful. The ODE curriculum 
coordinator has the responsibility for the exchange and 
sharing of all written reports on this topic among the 
regions. Reports should be exchanged prior to the first 
meeting of the curriculum task group. 
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3. Problems should be noted in the use of new instructional 
alternatives (alternative procedures) designed to support 
interdisciplinary perspectives. 
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INSTRUCTIONAL (SUPPORT) MATERIALS * 



Year One 



(Entry Year) 

1. Survey inadequacies and strengths of current program! 

Prior to the fall task force group meeting, the regional and 
headquarters DoDDS personnel are responsible for analyzing 
the worldwide test results to determine areas of strengths 
and weaknesses in the existing curriculum. An attempt will 
be made to determine whether the instructional materials con- 
tribute to any noted deficiencies or strengths. Other appro- 
priate evaluation data will be used to determine the adequacy 
of existing materials in terms of accomplishing stated objec- 
tives . 

2. Establish review criteria and procedures . 

Due to the ever- increasing number of instructional materials 
available, the formal review procedures must be extended and 
refined.' The task force group meeting in the fall should 
translate specific desired characteristics or criteria into 
appraisal forms. By using forms such as questionnaires, 
checklists or rating scales, the systematic recording, 
collection, and analysis of the most useful data can be 
promoted. H 
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Selection criteria for instructional material should 
include: (a) degree of correlation of material to DoDDS 
goals and objectives, (b) flexibility of materials in meet- 
ing learning and teaching needs, (c) motivational potential, 
(d) recency of copyright date, (e) fair and equal treatment 
of minorities and women, and (f) cost. 

These selection criteria may be included in a form or cate- 
gory checklist. A suggested form is included as Form A. 

Since categories vary in importance, a weighting procedure 
is recommended in determining the ^inal rating. This pro- 
cedure will assist the committee in determining the relative 
importance of the individual categories. The technique 
involves multiplying the rating of each item by its assigned 
weight. The sum of this product for each category produces 
the total effectiveness which can be used to compare similar 
vendor products. (See page 9 of Form B for a sample proce- 
dure . ) 

3. Send publishers a copy of objectives (functions), priori- 
ties, review criteria^ and review procedures . 

The task group, during the fall meeting, will identify 
objectives (functions), priorities, review criteria, and 
review procedures for publishers in a formal letter of 
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invitation to submit materials for review. (See Form C.) • 
It is not necessary to have an open invitation to all pub- 
lishers to submit materials; however, as a minimum, a re- 
presentive sample of publishers must be invited. It is 
desirable for committee members to identify, prior to the 
meeting, publishers that market materials which meet DoDDS 
established criteria for use. This will save valuable 
committee time and ensure that the best products available 
are reviewed. 

Publishers will be requested to provide material for review 
free of charge with no obligation to the U.S. Government 
for purchase. 

4. Conduct formal review in the regions . 

During the fall task force group meeting, plans will be 
developed to init^iate the formal review process, which will 
involve review committees in all regions. The purpose of ^ 
such a review is to determine which new or current materials / 
best meet comprehensive criteria established for use within 
DoDDS and to avoid costly pilot testing of a large number 
of texts and materials. 



6.1 



The person representing each region in each category being 
studied is responsible for establishing Formal Material 
Review Committees in the region. 

The number of committees established should depend upon the 
number of grade levels, courses, and essential texts and 
materials identified for review. By utilizing several 
committees, individual committee workloads can be reduced, 
and a larger number of locations within the regions can be 
represented. 

Committee membership should consist primarily of teachers, 
although students, parents, administrators, and the military 
community should be represented also. Participation by 
interested noneducators provides not only additional, 
helpful points of view, but also increases the work poten- 
tial of the committee. 

The committee chairperson should provide appropriate orien- 
tation training for the membership to insure effective 
accomplishment of various responsibilities. Such training 
should include practice exercises with the questionnaires 
and checklists, using instructional materials of the type to 
be reviewed. Throughout the committee process, all partici- 
pants should exercise a commitment to objectivity and recog- 
nize the importance of the established DoDDS curriculum 



64 



DS Manual 2000.5 



objectives as criteria for decisionmaking. They should be 
aware that they represent a large number of interested 
persons not present on the committee. 

5. Publish DoDDS listing of essential texts and p rogram 
materials for piloting . 

During the spring task group meeting, the results of the 
regional formal review will be consolidated in a ranking 
order to determine the materials which will be piloted 
worldwide. A listing of the materials chosen for pilots 
will be published and sent to the DoDDS CDC for review. 
After DoDDS CDC concurrence and ODS approval, the listing 
should be sent to participating publishers and regional 
offices. 

6. Order pilot materials . 

Pilot materials will be ordered during the spring task group 
meeting and funded by headquarters DoDDS after ODS approval 
of funding requests prepared by the task group. Regional 
representatives should bring a list of pilot schools to the 
meeting to facilitate the ordering process. 
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Year Two 



1. Conduct year-long pilot of new materials in regions , 
funded by headquarters DoDDS . 

The most important information possible regarding ultimate 
adoption of instructional materials is that which identifies 
the effectiveness as demonstrated by classroom use in DoDDS. 
In order to make this determination, a limited number of 
programs receiving the highest DoDDS ratings during the for- 
mal review process should be piloted. 

The pilot design will be on a year-long, DoDDS-wide basis. 
To the extent possible, each region will be iu/olved in part 
of the pilot design. Normally, one region will not pilot a 
product for the other regions. 

Classrooms, not students, are the units of measurement for 
pilot purposes. It is recommended that a sample of from 
four to six classroom population represent each program 
under pilot. 

Pretesting of pilot students should be accomplished prior to 
instruction. This is necessary to (a) determine their 
preinstructional level of mastery, and (b) to determine the 
equivalence or nonequivalence of the groups. 
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Valid, reliable, objective-referenced evaluation devices 
should be used that measure cognitive, affective, and 
psychomotor areas. 

Also, pilot implementation evaluation should be conducted. 
At the same time, it is valuable to look at process dimen- 
sions of instruction. It is possible that two programs 
could have the same cognitive impact on students, but that 
one of the two has processes which are felt to be more 
educationally defensible or desirable. 

In order to determine student gains, a posttest will be 
administered using the same devices used in the pretest. 
Post instructional opinionnaires should be administered to 
determine student and teacher attitudes towards the pilot 
materials. Factors such as legibility, age appropriateness, 
scope and sequence, durability, and quality of support 
materials could be included in the opinionnaire . 

A two-dimensional decision matrix can be used to assist in 
making the final program choice. The process is similar to 
that used in the final evaluation in the material review. 
(See Form A. ) 
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2. Publish adopted instructional materials list as a ps 
Manual , 

Based upon the pilot evaluation, a final listing of the 
essential texts and materials taat can be purchased with 
appropriated funds will be published as a DS manual after 
review by the DoDDS CDC and ODS approval. Regions have the 
option of implementing one or more of the listed programs. 

3 . Inform publishers of pilot results and plans by region . 

The essential texts and materials listing, along with imple- 
mentation plans by the regions, will be sent to all publishers 
who submitted material for review. This will allow publishers 
the opportunity to commit resources to support the program 
implementation . 

4. OPS negotiate level of in-service support and price 
of materials with publishers . 

Puring the pilot year, the ODS coordinator will negotiate 
with the publishers the level of in-service support the 
publisher will provide if their materials are adopted. 
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Generally, publishers can be expected, as a maximum, to 
provide in-service training free of charge during the im- 
plementation of their materials and one follow-up visit in 
subsequent years. (See sample Form D.) 

The price of the original materials during the adoption 
cycle, can also be negotiated. All commitments made by the 
publishers will be communicated by the ODS coordinator to 
the contracting officer, DGSC, Richmond, Virginia, prior to 
the initiation of the purchase orders. 
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Year Three 

When a region has made the decision to in lement more 
than one program named on the essential texts and materials 
list, it will request publishers to supply sample texts and 
materials to schools to aid them in making their final 
selection. School complexes are encouraged to select similar 
programs. This will facilitate support" of the programs in 
terms of in-service training and resupply of expendable 
materials. Orientation to new program materials should be 
accomplished through in-service before student use of the 
instructional materials . 



Purchase orders for materials to be implemented will be 
prepared in a timely manner so that materials will be in 
schools pri ^r to the start of the next school year. The 
funding for the selected essential texts and materials will 
be provided b;^' ODS. 



The curriculum coordinators will identify supplementary 
materials as possible support elements to interdisciplinary 
aspects. This infoimation will be submitted to the DoDDS 
coordinator for collation, who in turn will submit a report 
to the DoDDS CDC of the material requirements and estimated 
funds needed by each region. 
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Year Four 



For reasons of economy, it may be desirable to phase 
the new materials into the schools over a period of 2 years 
rather than to attempt a complete replacement. In schools 



where new materials are being added, the old matexials 
should be withdrawn and used for maintenance of existing 
programs. This will guarantee maximum utilization of educa- 
tional materials and keep implementation costs down. 

After implementation of the basic program, regional and 
headquarters DoDDS personnel will review and requisition 
basic materials necessary for support of assigned interdis- 
ciplinary responsibilities. This activity will be coordi- 
nated by the chairperson of the task force, but it will not 
require a special meeting of all members. One or more 
regions may be assigned the respoiisibility of conducting a 
formal review of essential interdisciplinary materials for 
DoDDS . 
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Instructional (Support) Materials 

Year Five 
Pre-entry Year) 

Iraplementation- of basic texts and materials will con- 
tinue with an attempt to accomplish complete replacement. 

Interdisciplinary support materials will be implemented 
as required. 
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YEAR 



6^ 



IN-SERVICE 



IN-SERVICE EDUCATION 



Year One 
(Entry Vear) 

1. Provide in-service on objective, function, or criterion- 
referenced test (CRT) writing; formal review, as required. 

a. The task group coordinator for ODS and each region 
must insure that each participant: 

(1) Receives written guidelines and explanations of 
specific responsibilities prior to the initial regional task 
group planning meeting. 

(2) Receives, on the basis of assessed needs, 
training necessary to accomplish specific tasks. As appli- 
cable, careful attention should be given to critical areas, 
such as: (a) selecting, writing, or modifying objectives or 
functions, (b) selecting, generating, or modifying CRT 
devices, (c) determining minimum essential criteria for the 
category under review and development, and (d) applying 
specific criteria for conducting a formal review of essen- 
tial texts/materials and services. Staff development activ- 
ities are usually provided early during the initial meeting 
of the regional task group. 



79 



2. Provide in-service on design, implementation, and 
evaluation of pilot programs and materials for regional 
representatives, as required. 

a. The Education Division chief for ODS and each 
region should insure that each headquarters and Regional 
task group coordinator: 

(1) Possesses necessary skills to design, imple- 
ment, and evaluate pilot programs which will be imple- 
mented as a major portion of year two activities. Required 
training should be provided by regional or ODS personnel, as 
available. 

(2) Designs the complete pilot program for year two 
activities. Any plans for school-level in-service orientation 
for pilot programs should be scheduled in the report to the 
DoDDS CDC regarding list of materials chosen for piloting. 



DS Manual 2000.^ 



Year Two 

1. Provide in-service for personnel conducting pilots, as 
required. 

a. ODS and regional task group coordinators should 
insure that participants in lo':al pilot programs: 

<1) Receive training in all regional pilot process 
requirements as required. This might include elements such 
as: <a) general knowledge of the entire piloting process 
and rationale, (b) sequential reportage requirements, (c) 
administration of the evaluation components, and (d) uniform 
interactions with publisher representatives. 

(2) Receive in-service instruction regarding new 
instructional concepts, processes, or content unique to the 
program being piloted. This training is frequently provided 
by publisher consultants. Employment of siich services, how- 
ever, should be uniform for all publishers of pilot programs 
for a designated area of study. 

2. Provide in-service education on CRT and evaluation develop- 
ment and validation, as required. 
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•a. ODS and regional task group coordinators should 
insure participants in the regional evaluation development 
program: 

\ (1) Understand their role and possess appropriate 
skills to meet their responsibilities as members of a test 
specification project. 

(2) Understand their responsibilities and possess 
appropriate skills in the prototype and field testing pro- 
gram* 

3. Provide in-service education on the need to infuse 
interdisciplinary perspectives into disciplines, or support 
services, as required. 

a. Th^ Education Division chief for ODS and each 
region should insure that each ODS and regional task group 
coordinator: 

« 

(1) Understands the rationale and requirements to 
provide interdisciplinary perspectives in selected priority 
areas such as: (a) drug education, (b) multiethnic studies, 
.(c) intsrcultural education, (d) career awareness, (e) 
mental health, (f) interpersonal skills, (g) moral develop- 
ment, (h) compensatory education, (i) English as a second 
language, and (j) early childhood education. 
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(2) Plans a program for infusing priority interdis- 
ciplinary perspectives into applicable disciplines. That 
program should include all aspects of a total instructional 
system: (a) objectives, (b) instructional alternatives, 
(c) instructional materials, (d) implementation, (e) 
evaluation, and (f) in-service education. 
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Year Three 

1. Provide in-service for implementation of new materials, 
as required. 

a. The task group coordinator for ODS and each region 
should insure that local educators: 



(1) Identify assessed needs regarding in-service 
training prior to incorporation of new programs or services 
in the following year. 

(2) Receive training in new programs and services, 
on a priority basis, to the extent feasible or possible. 
Commitments made by publishers at the time of formal review 
should be employed to effect as much of this training as is 
necessary or possible. 



YEAR 



2. Provide in-service education on the local use of a 
criterion-referenced evaluation program. 



a. The Education Division chief for ODS and each 
region should insure: 
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(1) General understanding of the rationale and pro- 
cesses associated with the use of criterion-referenced 
testing in the local school program by above-school and 
school personnel. 

b. The task group coordinator for ODS and each region 
should insure that local educators: 

(1) Understand evaluation programs available for 
their use in a specific discipline or interdisciplinary area 
of study. 

(2) Incorporate use of available evaluation pro- 
grams in the process of improvirtg- instruction. 

(3) Cooperate with any limited ODS or regional 
administration or reportage requirements regarding the use 
of CRT instruments or processes. 

3. The task group coordinator for ODS should prepare a 
brief informational report for the DoDDS CDC of in-service 
education activities related to the Five-Year Curriculum 
Development Plan that includes: 
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a. A description of systemwide in-service education 
programs conducted for regional and school staff and a 
summary of participant evaluation feedback. 

* 

b. A description of regional in-service education pro- 
grams related to needs identified during the curriculum 
program review, giving a summary of participant evaluation 
feedback of the course or workshop. Also, a summary of 
in-service provided for implementation of new materials 
should be included along with recommendations if problems 
were noted. 

c. A description of interdisciplinary in-service activi- 
ties that took place during the year two emphasis on infusing 
interdisciplinary perspectives into applicable subject 
matter disciplines. 
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Year Four 

1. Provide additional in-service education for implemen- 
tation of new materials, as required. 

a. The task group coordinator for ODS and each region 
should: 

(1) Insure early completion of ' additional in-service 
requirements to support proper implementation of new programs 
or guides. 

(2) Facilitate local understanding of and cooperation 
with implementation evaluation requirements associated with 
the incorporation of new programs. 



YEAR 



4 
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In-service Education 

Year Five 
(Pre-entry Year) 

1. Provide in-service education to participants of the new 
development cycle, as Required. ^ 

a. Members of the^ DoDDS CDC should review the in-service 

f. 

program operating during the current cycle. In addition to 
general recommendations for improvement, specific redommenda- 
tions for improvement of the in-service program for the next 
cycle should evolve from this review and be sent to the task 
groups for action. 

b. Members of the DoDDS CDC should discuss and identify 
specific in-service activities likely to be needed for the. 
following year's program. Budget estimates for ODS and 
regional-level use ;:hould be prepared for the fiscal Divi- 
sion at each appropriate level. 

c. The Education Division chief for ODS and each 
region should insure that the Task Group coordinators for 
ODS and each region: 
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YEAR 

5 



(1) Receive written guidelines, explanations, or 
training necessary to satisfy all responsibilities of such 
an assignment. 

(2) Develop the criteria and procedures for select- 
ing regional participants. If unique capabilities are 
required, selection criteria should include consideration of 
participant interest, commitment, and abilities. 
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Evaluation 

Year One 
(Entry Year) 

1. Analyze and Interpret Worldwide Evaluation Results . 

Analyze eva'".i'.^tion data resulting from the year five evaluation 
program. This would include an analysis of actual test 
results as well as (1) data relating to the levels of use, 
(2) teacher and pupil opinion, (3) cost, and (4) in-service 
participant evaluations. This data is provided the task 
group for use m the formal review process as <*. lorm of- 
needs assessment. 

2. Review Worldwide Evaluation Instruments. 

The evaluation ana curriculum coordinators will jointly 
conduct a thorough study of the test instruments used in the 
worldwide evalu'ition program. The purpose of the study is> 
to determine the reliability and validity of the instruments 
as well as the appropriateness of the administration proce- 
dures. The study information received from the school-, 
regional-, and ODE-levsl staffs will provide suggestions which 
the curriculum task group can use in modifying or changing the 
instruments. 

95 



3. Design Pilot Procedures . The design of the entire 
piloting process is developed jointly by evaluation and 
curriculum coordinators which includes (1) the selection of 
the empirical design, (2) the sampling techniques and the 
data collection procedures to be used, (3) the data analysis 
techniques to be employed, and (4) a time frame within which 
the program will be managed. The curriculum task group will 
use this design to implement and monitor the use of the 
piloted instructional materials. 

4. Select Instruments for Pilbts . 

As headquarters and regional curriculum coordinators identi- 
fy testing needs, development and field- testing of instru- 
ments and their administration procedures will be under- 
taken. Items taker from the item pool developed under 
commercial contract will be used in most cases. Where items 
are not available, new test specifications will be written 
and in-house items developed to meet those specifications. 

5. Monito- Revision of DoDDS Objectives . 

i 

A systematic review process will be developed for use by the 
curriculum task group when revising and changing DoDDS 
curriculum objectives. School-level review and comments 
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of DoDDS objectives will be incorporated into the finished 
objectives document. The review process will insure inclu- 
sion of objectives which are both measurable and written at 
the appropriate level of specificity. ""~~^\ 
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Q Year Two 

1. Evaluation coordinators will provide appropriate train- 
ing in test specification generation to the curriculum task 
group responsible for developing test specifications. Test 
specifications for the worldwide evaluation of curriculum 
objectives in grades 4, 8, and 11 will be developed, reviewed, 
and revised before providing them to a contractor with 
professional test development and experience in the summer 

of year two. Joint monitoring of test specifications will 
take place as the contractor develops the required tests. 

2. The ways i^. which the pilot materials and procedures are 
actually being used in the classrooms will be monitored 
throughput the school year and compared to the planned 
in^lemen^tation. Pilot testing of new materials will be 
completed during year two. 

\ 

3. A decision matrix for using pilot test results of instruc- 
tional materials should be developed jointly by the evalua- 
tion and curriculum coordinators. 
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4. The pilot test results gathered during year two should be 
summarized jointly by the evaluation and curriculum coordi- 
nators. The ODS curriculum coordinator for the task group 
pilot-testing new program materials has the responsibility 
for submitting the report to the DoDDS CDC. Regional curri- 
culum coordinators have the responsibility of providing 
summary information to schools and the corresponding ODS 
curriculum coordinator regarding the results of pilot test- 
ing of new materials. 

The pilot-test results will be a section of the report to 
the DoDTJS CDC on selection of instructional materials. The 
report should explain how the pilot-test results were used 
in the final selection of instructional materials. 
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Year Three 



1. The design for implementing selected curricular mate- 
rials should be monitored. .This process should include, at 
a minimum, a review of in-service, lo9istics, finance, and 
durability of materials which are associated with the design. 



2. As test specifications expand, the test pools expand, \ 
providing " items yhich can be used in additional testing sit- j 
uations. Curriculum coordinators should develop a process 
to monitor this" expansion and development. This is necessary 

r* 

in order to insure, currency and release of test items for 
multiple uses. 



3. Simple and quj.ck (for school staff) formative evaluation 
procedures should be included when developing or reviewing 
curricular guides. As an example, a one-page evaluation 
sheet, included at the end of each curriculum guide or pro- 
gram document, could provide the evaluation and ci^rriculum 
coordinators with an indication of its usability and practi- 
cality. ^' 

v.. 

** * . * 

4. Evaluation coordinatdrs will assist the curriculum 
coordinator's in the preparation of the brief report of 
in-service activities related to the Five-Year Curriculum 
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Development Plan. Evaluation coordinators should be con- 
sulted specifically regarding the summary and interpretation 
of participant evaluation feedback of courses and workshops. 
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Year Four 



1. Curriculum coordinators should monitor the implementa- 
tion of selected instructional materials and guides. The 
development of a measurable design, which would insure the 
effective implementation of instructional materials and 
guides, should include the following factors: (1) the appro 
priateness and timeliness of delivery of materials to staff 
members; (2) the provision of in-service-;^tin\e to staff for 
explanation and clarification of selectexl materials; (3) 
collecting teacher feedback on such materials? and (4) 
providing this input back into the review of evaluation 
procedures . 
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EVALUATION 

Year Five 
(Pre-^entry Year) 

1. The evaluation and curriculum coordinators should jointly 
review those evaluation procedures which have been in 
operation since the beginning of the cycle* Areas of strength 
and weakness of the evaluation scheme should be identified 
and modifications made to make the evaluation activities 

more effective and efficient* School-level evaluations 
conducted by the accrediting organization for DoDDS, high 
school departmental evaluations, and results of systemwide 
tests should be used to identify program strengths and 
weaknesses . 

2. Examination should be made of how materials and pro-- 
cesses were used and what problems have been identified 
relative to lo^i-stics, training, utility, acceptance, etc. 
The "level of use"s^of the program should be estatlished 
through appropriate evaluative techniques. Regional curric- 
ulum coordinators, through onsite visits and needs assess- 
ment forms, should prepare recommendations for program 
improvement based upon evaluative data as well as observa- 
tional information . 
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3. Procedures for the interpretation, »-eporting, and dis- 
semination of data to be collected in the worldwide testing 
program will be developed jointly by the evaluation and 
curriculum coordinators. Types of data analysis to be used, 
report formats, and ways in which test information should be 
distributed should be agreed upon by ODE and regional-level 
coordinators before testing begins. 

4. Test items, instructions, and report formats should be 
monitored by the evaluation and curriculum coor(Jinators as 
they are received from the contractor. Test forms should be 
prepared by a professional contractor whenever possible with 
school-, regional-, and headquarter-level input on the content 
and format most appropriate for each particular grade level to 
be tested. 

5. The Evaluation Branch a'^ministers the worldwide testing 
program. This includes the selection of sites, notification 
of schools as to testing dates, pretest instructions to staffs 
on administration requirements, distribution of tests, 
collection of completed tests, sending of answer sheets to 
contractor for scoring, and the disposi' ion of test boo^Klets 
and instructions after testing. The curriculum coordinators 
must work closely with the evaluation coordinators and 
school staffs in order to make appropriate interpretations 
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of test results. Written summaries of test results should 
be reviewed and utilized by curriculum coordinators when 
•developing program recommendations. 

6. Evaluation coordinators will provide an orientation 
regarding the evaluation components in the re^^Xew cycle to 
those staffs who are assuming responsibilit;^ for a curriculum ^. 
area for the first time. This overview should identify how 
and when evaluations are to be made, by whom, and with what 
tools. It should clarify the scope and s^uence of the 
evaluation requirements and emphasize the importance of 
evaluation in sound decisionmaking. 
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CHART 5 



REPORTS TO THE DODDS CDC BASED ON FIVE-YEAR CURRICULUM DEVELOPMENT PLAN 



CrjECTlVES 
(FINCTIONS) 



INSTRlXnONAL (PROCEDrRAl ) 
AlThkNATlVFS 



INSTKrCTIONAl (SnM'i^RT 1 
MAl^H lAl S 



EVALUATION 




Task groups tiubmlt draft vuj'les 
of (a) general, programs 6 
sample Instructional ohjfctlves, 

(b) scope and svquenc, a.nd (r) 
list of minimal t>,i?*ential 
objectives during the first 
aeetlng with DoODS CDC. 

2. Task groups siubralt finished 
copy which has incorporatt*d 
regional school «taff suRges- 
tions for revlslunti of 1. (a)- 

(c) above during the second 
oeeling with the DoDDS i:ut. 



I. At the fall meeting. f^ffV 
groups submit sutomarv ot 
renlon:! .ind I'.S. findings and 
reconmendat ions on alternatives 
to trv jn DobDS. 



1. F.ill nifet tt»K with lK»M!)S (DC - 
task prnups submit pl.ins fur 
initlatlns f(»rtti.U Inst r»u t lunn 1 
material ri*vli*w with details \'! 
re^.ii'ti.il * i»mmll I res, forms, .iml 
(lues! I(jnn.ur **s, and pub) isbers 
to bv^ nut if ifd. 

2, Spr infi m»M'l my witb UoliDS 
C\)(' (a^ t.isK i:roi.;*s submit 
list nf m.it t*r l.il s \ hosen lor 
pilots t »r * PC * olu ur r en* V nul 
iM)S ,ip|»r(V.il prior t.' st-ndlnv. 
t*' publishers .jnd r«->'. lon.il 

of f i. fS ; and U. ) t .ixk |,:r .nip-* 
submit tnndini: trqurst t *)r 
piitJi ni;iIfriHlH t :uit?I>S tin t.-i 
I «^Til nrr fni \* ,nu! * i «pp» '. 




2. ODS «oordin.)tor submit report 
of pilot ti'st result of alterna- 
t Ives usi'd by Si*bot>l s in rt^i.n ion 
to nt'W materials. Summary of pro- 
gram improvements iwted or problems. 
V»*te essfnti.il man.^nement sopp.jrt 
a( t Iv it ie.*; . 



}. Ob<^ <-oord In.M or submit final 
H<4tln»( *»t essrntl.U texts ind 
mat er ia I •» ( h:iN»«d upon pilot tost 
rei»uItN) that **-in hi* ; ir* h.isod 
with apprupr i.cted fund-*. Mnal 
1 1st iPj^ to h<- pub! isbi'd .is ,^ 
DS manual .ittt-r DoIiDS CIK ro\ ie<* 
dnd ODS appri>val. Funding esti- 
mates for tot.il implemetitat Jon 
of new prt*gr .im>> .ire pr»>v i did to 
the OoDUS ClJf bv OUS coordinator. 



I. iM»S • ut I i. ultini vtiord i nator 
subrrii viimm.irv report of re- 
sult-- .t pilot testing of new 
mut-t i.iis .\ new set t U>n of 
t bi rop.*rt to t hr Ih.DDS ClX: on 
f In.tl m.iteri.tl sfleition. T>ils 
st itlon ot I h\- ropt)rt should ex- 
pl.il.j h.'W pilot t*'st results were 
u'-.«l in t hi* tln.il s*lf*tl'»n of 
In^ t f o. t {••xy.i I m.i t f r 1 .<l s 



YEAR 




}. MDS * .loTdliMtor «;tibn>it ri«port 
ot prnt.Iems in use of new mnter- 
lals if major t hankos In insttu*- 
t iono i or pr o( I'dur a I .i 1 1 et ■ ..tt 1 v»-s 
Submit Kuidelinrs anu •^-.nnnls 
devflopt-d ti«r s« l.o..l ns*- .intl t* \. rt 
on I heir iDp.it t 




CDS coodinator submits to 
DoDOS Cnc an inf i^rmat iona 1 
copy of the letter to 
regional coordinators ini*^ 
tiatlng objectives deve.jp- 
aent 4nd exchange. 



ODS ^ o.-r<i in.it <i N.il-n.it brl^l 
rt por t ot i n - -rf V * .o. t U' J t les 
r «■ Lit eii t '1 i-^ j^-.ji . .If I n u I .iff. 
pro^;rart, !i-vi»w wnii -^unn'i.irv .'l 
p.irt i> ip.nit tv.i liiit i v«- lit.Jh.nl- 
ol » ■■or ».!■ w.-r ^ -.Ij.'p. 



A. Keport trwm oi^S . iror.l In.M --r 
onIv*i! tH^*^ yr.np von.Jmtvd 
a tormai r^'View ut »*sM-ntial 
i nt erd is* i p 1 injr V ma t » r I.i I t ■« 
s t t.den t s . Repor t sbuu 1 l1 i n^ I *. 
»■■ • 171, it eu f ond » in i drd l"* b 
J \ V Ion . 
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BASIC 



SUPPLEMENTAH 



RATING 



CRlTEitLA FOR EVALUATION OF ESSENTIAL TEXTS /MATERIALS 



!• DESCRIPTIVE DATA 

A. Cou:"se Title or Area of Consideration: 

B. Student Grade Level: 

Reading Level : 



II* 



Other 



6-8 



9-12 



C. Producer Data: Title 



Author 



Publisher 



Copyright/Date 



D. 
E. 
F, 
G. 



Intended Duration of Material; 



9 wks 



18 Wl ; 



year 



Other 



Additional Modified Facility Space Required: YerU NoQ 

In-Service Requirements: Extensive □ SomeG NoneD 

Recoirauended Distribution: " 



H- Initial Cost/Pup il/Program $ 



Maint Cost /Pupil/Proaram/Year $ 



1. External Effectiveness Data (attach data and check below if available/ 
used) : 



Source 



Availabil ity 



Utilized 





yes 


no 




yes 


no 




















^ 0 







Other Schools (list):_ 
OBJECTIVES 



A. Are general goals indicated? YesD 

B. Are specific objectives provided for teachers use?..Yesn 

C. Attach' A/B above if available Attached? .YesD 

Review and attach publisher provided assessment of how 
well their materialjs support DoDDS objectives (if 
provided) Attached? .YesG 

E. Complete and attach appropriate fphje^^tive form. 



NoD 

WoD 

NoD 
NoD 



*Educational Products Information Exchange 
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Yes □ 


No □ 


Somewhat Q 


Yes □ 


No □ 


Somewhat D 


Yes □ 


No □ 


Somewhat □ 


Yes □ 


No □ 


Somewhat [Z 


Yes □ 


No □ 


Somewhat D 



F. On the scale below» after committee discussion of all data generated 
in this section, circle one of the six numbers that represents the 
committee's judgement of how well the materials would support DoDDS 
objectives. 

Provides no support ^ . ^"^Y supports 

of objectives 1-2 3 4 5 6 objectives 

III. FAIR AND EQUAL TREATMENT OF MINORITIES AND WOMEN 

A. Material is free of racial bias? 

B. Material is free of ethnic bias? 

C. Material is free of sex-rnle stereotyping? 

D. Material is free ot religious bias? 

E. Material is free of job denigration? 

F. On the scale below, after committee review of the above data, circle one 
of the six numbers that represents the committee's judgement of. -how well 
the materials would provide for fair and eqval ;:re?.tment of minorities 
and women. 

Totally unfair . ^ Fully fair 

and unequal I 2 3 4 b b equal 

IV. ORGANIZATION OF MATERIALS 

A. Are the physical characteristics such as sound, color, general appearance, 
and data content appealing? 

Excellent □ Good □ Fair □ Poor □ 

B. Is the scope of the content appropriate? Yes □ No □ 

C. If sequencing is essential, is the sequence of 

materials appropriate? "tc-sD No □ 

D. Are extensive additional supplementary materials ^ 
required? v Yes □ ^ No P 

Other {--y-^ 

E Is the readability level appropriate for the intended 

level of use? Yes □ No □ 

Other ^ 

F. On the scale below, after committee discussion of the data generated by a 
review of criteria ia Jihis section, circle one of the six numbers indicating 
the degree of adequacy regarding the selection, scope and sequencing of 
content . 

Totally _„ — — Fully 

Adequate 1 2 3 A 5 6 Adequate 
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V. INSTRUCTIONAL METHODS 

^ - ■ - 

A. What modes of instruction are most frequently employed? 

LectureD Discussion □ Programmed InstructionD Self /Assessment □ 
Other 

B. Does the instruction methods/materials require extensive 

pre-class preparation? * Yes □ No □ 

Other _^ 

C* List technical manuals or teacher guides provided or available. 

D. On the scale below^ after committee discussion of the instructional 
methods implied or required ^ circle one of the six numbers incicating 
committee judgement of the suitability of those methods. 

Totally Fully 

Unsuitable 12 3 4 5 6 suitable 

VI. EVALUATI ON 

A. Are adequate test materials provided for student and teacher use? 

YesD NoD Other 



ERIC 



B. Do test items measure student achievement of indicated objectives? 
Yes □ No □ Other 



C. Are test items adequat'e fox inxorming teachers of student progress? 
YesD NoG Other 



D. Has the producer provld«id Information regarding test 
reliability and validity? 

YesD NoQ Other . 



E. Has the producer provided evidence of student ii^volvement in formative 
e^^aluation employed in materials developed? 

YesD NoD Other 



F. On the scale below> after commr^ccec discussion of the evaluation coiApoi.ents 
of the materials^ circle one of the six numbers that indicates the adequacy 
of test materials and data. 

Totally Fully 

Inadequate 1 2 3 4 5 6 Adequate 

VII. TOTAL RATING 

A. Write and attach a brief statement on how these materials compare with those 
currently being used or why they should be incorporated, If new: 
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B. On the scale beiuw, after committee discussion of the overall potential 
effectiveness of these materials (sections TI-IV), circle one of the six 
numbers indicating committee judgement of the degree of that effectiveness 
and record that number in the spa.c provided on page K 

Totally . l^^^y 

Ineffective 1 2 4 5 6 Adequate 

VIII. FORMAI, REVIEW COMMITTEE MEMBERS 



-Signature of Chairperson Date Location 
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FORM B 



/ 



DOD DEPENDENTS SCHOOLS 
ARTS & HUMANITIES 



RATING 



CRITERIA FOR EVALUATION OF ESSENTIAL 
TEXTS, MATERIALS AND PROGRAMS IN ART, MUSIC, AND HUMANITIES ' 



1. DESCRIPTIVE DATA 

A. Course Title or Area of Consideration: 

B. Type of Material: 

i 

1. Cir/.le: - Text, Ma^terlals, Program 



I 



Reproduction Transparency 

\ 

Other 



2. Check: Sound Color B&W 



ength^ 



Film Filmstrip Slides Recording: disc 



Chart * Graph 



tape 
Map 



3. Indicate type of package: Single item □ Set or Kit □ 

'Number of Components 



Student Grades^ Levels > or Subject: 



D. Producer Data: 



Title 



Author 



Publisher 



Copyright Date_ 



E, Publisher: Intended Grade Span of Material: 



Additional Space of Modified Facility Space Required: 
G. In-Service Requirements: Extensive □ 
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Yes □ No □ 

Some □ None □ 

1 Of 10 



H. Recommended Distribution: 



□ One per student □ Number . er Class 

□ Othe^ Distribution 
I. Initial Cost per Pupil of Program $_J . 

J. Maintenance Cost per Pupil, or Program, per Year $ 



K, External sources: Effectiveness Data (attach data and check items below) 

Available Utilized 



Producer 

EPIE'^ 

Other Schools (list) 



Yes 


No 











Yes 


No 











L. Internal Sources: Effectiveness Data (attach data and check items below): 

1. DoDDS Learner Verification , Yes □ NoD 

2. By Grade Levels Yes □ No □ 

3. Method Used.. DXesting Dln-service Training 

□ Discussion □ Other, List 

4. DoDDS Teacher Verification: 

□ Testing □ In-Service Training DDiscussion 

□ Other, List , 



*EPIE Educational Products Information Exchange 
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II- OBJECTIVES 

A. Are general objectives: 

Apparent within the content Yes □ Nop 

* Available for teacher use Yes □ NoD 

If available, attach. 

• B. Review and attach publisher provided assessment of how well their 

materials support DoDDS objectives (if provided, Indicate) YesU NoD 

C. Compatibility with General Objectives 
2.1 Individual Ratings: 

LOW HIGH 
2.1.1 Demonstrates Understanding of Purposes 



2.1.2 Displays Knowledge of Appreciation 

2.1.3 Displays Humanistic Attitudes & Values 

2.1.4 Initiates Active Participation 

2.1.5 Demonstrates Respect for Creative 
Expression 

2.1.6 Reveals Contribution of Arts to 
Culture 

2.1.7 Extends the Use of Environment- 
Chart Future 

2.1.8 Identifies Pertinent Modes of 
Creativity for Leisure Time 

2.1.9 Identifies Career Categories and 
Structure 

2.1.10 Justifies Support of Aesthetic 
Expression 

2.2 Total Rating 
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D* On the scale below, after committee discussion of all data generated in 

this section, circle one of the four numbers that represents the cotnmittee^s 
judgment of how well the materials would support DoDDS objectives. 

Provides no support Fully supports 

of objectives 12 3 4 objectives 

III, FAIR AND EQUAL TREATMENT OF MINORITIES AND WOMEN 

A. By circling one of the four levels, rate the degree tc which the materials: 



Unfair Fair or 

Biased Unbiased 



C0M!4ENTS i 



ERLC 



1. Project a fair and unbiased treatment of 12 
racial groups. 

2* Project a fair and unbiased treatment of 

ethnic groups. 1 2 

3. Project a fair and unbiased treatment of 

religion and religious practices. i 2 



E. How well do the materials avoid sex-role stereotyping? 

Poorly Well 

12 3 4 

C. How well do the materials avoid job denigration? 

Poorlv Well 
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D. On the scale below, after committee review of the above data, circle one 
of the four numbers that represents the coTumittee's judgment of how well 
the materials would provide for fair and equal treatment of racial, <?thnlc 
sex, religious; (and vocational groups). 

Totally unfair ■ Fully faii^ 

and unequal. .12 3 4 and equal 

ORGAN T ZATI ON OF MATERIALS 

A, Are the written content materials motivating? 

y^PoorD FairD Good □ ^ Excellent □ 

What is the- overall aesthetic quality of the product? 
PoprD FairD Good □ Excellent □ 

C. the produqt durable and practical enough for student and 
teacher use?' 

Poor □ Fair □ Good □ Excel lent □ 

!)• Are the materials directed toward: Student □ TeacherD 

E. Indicate if the vocabulary and content is designed or stated 
in a manner appropriate for: ^ 

Slow learning students □ Average students □ 

Academical ly talented students □ Bilingual students □ 

F* Is the scope of the content appropriate? Yes □ NoD 

G. If sequencing is essential^ is the sequence of materials 
appropriate for DoDDS* program? Yes □ ^ NoD 

H. On the scale below» after committee discussion concerning the 
organization and quality of the materials, circle one of the four numbers 
indicating committee judgment of the organization^ quality^and 
appropriateness of the materials. 

Totally Fully 

Inadequate 12 3'* Appropriate 
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V. INSTRUCTIONAL METHODS 

A. List technical manuals or 'teacher guides provided or available. 
List the items on the^back of this page or attach a separate list. 

B. Does the material require teacher in-service training on the use of 
the items? * YesD NoQ 

C. Identify the modes of instruction which are likely to be most 
effectively employed with this material. 

Demonstration Q Problem'-Solving □ Lecture □ 
Listening □ Discussion □ Independent Study □ 
Programmed Instruction □ V Self-Assessment □ Drill □ 
Analyzation □ Reference □ Other 



) 
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D. Do the instructional methods and materials require extensive preclass 
preparation? Ves □ No □ 



Other 



E. On the scale below, after comraittee discussion of the instructional methods 
implied or required, circle one of the four numbers indicating committee 
judgment of the suitability of those methods. 

Totally Fully 

Unsuitable 12 3 4 Suitable 

VI. EVALUATION OF MATERIALS 

A. Are extensive additional supplementary materials required? YesD NoD 



Other 
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B, Check, items which apply to the ma,terial: 

Poor Fair Good Excellent 



1. Teacher's guide; captions; 
narrative 



□ □ □ □ 



2. Continuity of outline 

and content □ □ □ □ 

3. Vocabulary □ □ □ □ 

4. Authenticity of content □ □ D ^ 



5. Quality of: 
a . Sound 



□ □ □ □ 



b, Color □ □ □ □ 

c. Photography or artwork □ □ □ D 
6. Total Instructive Value □ □ □ □ 

C. On the scale below, after committee discussion of the data generated by 
a review of criteria in this section, circle one of the four numbers 
indicating the degree of adequacy regarding the selection, scope, and 
sequencing of content. 

Totally Fully 

Inadequate 1 2 3 4 Adequate 

fr 

VII. EVALUATION OF TESTING MATERIALS 

A. Are adequate test materials provided for student and teacher use? 

YesD No □ Other , 



B. Do test itews measure student achievement of indicated objectives? 
Yes □ No □ Other 



C. Are test items adequate for Informing teachers of student progress? 
Yes □ No □ Other 
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D. Has the vendor provided information regarding test reliability and 
validity? - YesD NoD 



Other 



E. Were the test materials field tested? YesD NoD 



Other 



F» Were students employed in the field test of these test materials? 

YesD NoD 

Other 



G. On the scale below, after committee discussion of the evaluation 
components of the materials^ circle one of the four numbers that 
indicates the adequacy ol test materials and data. 



Totally Fully 

Inadequate 12 3 4 Adequate 



VIII. TOTAL RATING 



A. Write and attach a brief statement of how these materials compare with those 
currently being used or why they should be incorporated into the program, or 
adopted to replace current materials, if new: 
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B» WEIGHTING INSTRUMENT FOR FINAL EVALUATION TOTAL 

1. On the scale below, enter In Column A the ratings tram Sections II-VII, 
indicating committee judgment of the degree of adequacy and effectiveness 
of the elements evaluated in those sections. 



2. Weighting instructirns:* 

All items on this evaluation are not of the same importance in evaluating 
educational materials. For this reason, a second parameter is added to the 
evaluation process which weights each section according to its perceived 
importance. A sample set of weights has been provided in Column B. If you 
feel the provided weights are inappropriate, please place your recommended 
weights in parenthesis alongside the provided weights in Column B. Your 
weighting will be taken into consideration when the final ranking of materials 
is accomplished. In any case, the total weighting must equal 100 points in 
Coltimn B; therefore, when an item is Increased in points, there must be a 
corresponding decrease in points for another item or items. 

Instructions:. Multiply section ratings (Column A) with weight (Column B) to 
to arrive at subtotals (Column C) . A X B ^Subtotal C. ' 



SECTION CRITERIA RATING WEIGHT SUBTOTAL 

A B G 



II. OBJECTIVES 




3t) 




III. FAIR AND EQUAL TREATMENT 
OF MINORITIES AND WOMEN 




5 




IV. ORGANIZATION OF MATERIALS 




25 




V. • INSTRUCTIONAL METHODS 




15 




VI. EVALUATION OF MATERIALS 




15 




VII. EVALUATION OF TESTING 
1 MATERIALS 




10 





Add subtotals from Sections II-VII. Enter 

this rating (total) on front page of the TOTAL 

evaluation form (upper right-hand corner). 

*This phase of the evaluation process is optional when the evaluation is 
accomplished by an individual rather than a committee. 
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IX. FORMAL REVIEW COMMITTEE MEMBERS 



Name of Committee Member 



School 



Signature of Chairperson 



Date 



Location 
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DEPARTMENT OF DEFENSE 
OFFICE OF DEPENDENTS SCHOOLS 
2461 EISENHOWER AVENUE 
ALEXANDRIA, VIRGINIA 22331 



DS Manual 2000.5 
FORM C 



October 4, 1978 



MEMORANDUM FOR Vendor 

SUBJECT: Invitation to Subtait Essential Arts Texts, Materials, and 
Programs for Formal Review 

The Department of "Defense Dependents Schools (DoDDS), with 
five regional administrative offices, 

operates American elementary and secondary schools through- 
out Europe, the Middle East, the Atlantic Region, and Asia. These 
schools are staffed with more than 7,000 American teachers in 261 
schools providing an educational program for approximately 140,000 
children of American military and civilian personnel. . 

Each year, texts, materials, and programs for selected subject areas 
are formally reviewed to determine whether new^ current materials 
better meet the comprehensive criteria established for use within 
the DoD. Dependents Schools. After the formal review process, " texts, 
materials, and programs which best meet the established criteria nay 
be authorized for piloting. 

The purpose of the formal review is two-fold: — 

1. To minicDdze pilot testing of large volutaes. of essential t^ext3» 
materials » and prograo^* 

2. To insure ultimata utilization of essential ca:;ts,^ laaterials-, 
and progrfcu', consistent with the philosophy, goals, and 
objectives of DoDDS. 

• During school year 1978-79, formal review conmiittees will be established 
iflT each p£ the geographical regions to review essential texts, materials, 
and programs in the arts and humanities, K-12. 

'upon. completion of tfhe formal review of .texts, materials, and programs 
which are submitted for examination, each participating vendor -will be 
-given written "notification of the final selection of materials. • 
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SUBJECT: Invitation to Submit Essential Arts Texts^ Materials, and 
Frograma for Formal devien^ 



For those vendors wishing to participate in DoDDS formal review process, 
the following gutdellnes and requests for information should be care- 
fully read and observed; 

« ^ 

Forward a formal letter of application, not later than 
Noveabar 1» 1978, to: 

Mr. Steve Motta, Chief, Education Division 
Department of Defense Depsnderts Schools 
Hoffman Building No. 1 
2461 Eisenhower Avenue 
. Aiexandria, Virginia 22331 

c 

The letter should include: 

a»- A bibliography of texts, materials, and programs which 
will be submitted* 

b* A stateiaent indicating the materials and correlation 

information will be submitted not later than November 15 > 
1978. 

c* A statement that three or four c;ets of the texts ^ materials, 
and programs will be provided free of charge without further 
obligation to the U.S* Govemnant* 

d» Vendors may identify items they wish to have returned • 
Where textboolcs or similar types of expendable paper 
materials are submitted for examination, we wouli prefer 
to retain such material permanently unless this office is 
advised In your confirmation letter (paragraph 1* above) 
which items are to be returned. No materials will be 
returned prior to April 1, 1979. 

2» Vendors should only send for review their most recent materials 
which can be classified as essential to the Arts Program. 

3. DoDDS has 16 mm film projectors; slide projectors, including 
the carousel-type projector, cassette tape recorders, record 
players, film loops (supar^8), overhead projectors, filmstrip 
projectors^ display boards, and 1/2- o^^ 3/4-inch video tapes. 

4 ^ 
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SUbJECX; Invitation to Submit Essential Arts Texts, Materials, ani 
Prograns for Formal Review 

• " ' . ■ /, 

4. For the arts, our essential interests are in the s^clflc \ 
program arei^s of the visual arts, performing arts» written 
arts, film arts, spoken arts# to Include the historical, ^ 
aesthetic, and humanities-oriented programs. The materials 
should be basic and essential to a variety of specific interests 
and experience gained in' programs such as design, drawing, \ 
painting, ceramics, sculpture, etc. We are interested in basic I 
programs and , essential Jiaterlala that are directed toward a I ^ 
variety of modes of instruction such as interdisciplinary and 
intercultural or instruction suitable for a variety of student 
l^irouplngs by age and grade levels presenting a broad range of 
student ability, including gifted students. 

5. Vendors who elect to submit items to be considered in the 
formal review process, must comply with the follovflng procedures: 

a. Provide descriptive data , section 1, of (enclosure 1) * 
"Criteria for Evaluation of Essential Texts, Materials, 
and Programs in Art, Music, and Humanities." 

b. Provide a correlation between DoDDS objectives (enclosure 2) 
and the materials submitted indicating where the ob4 active 
is covered In the materials. 

c. Information required (a. and b. above) and the items to be 
reviewed by DoDDS commit teea should be subkitced at the 
earliest possible date, but not later than November 1, 1978, " 
to each formal review site of the task group as listed ♦ 
(enclosure 3) . . , 

Enclosed is a copy of our "Introduction to The Materials Review 
Process" which will aiid in the preparation of information 
requited. (Enclosure 4) i . 

I 

6. All contracting for DoDDS is processed through the Defense 
General Supply Center in Richmond, Virginia, upon requisition 
by the schools or directorates. Examination of any item 
constitutes no promise or obligation to buy, and such examina- 
tlon, when made, is without coat of liability to the U.S. 
Government . 
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. SUBJECT: Invitation to Submit Essential Arts Texts, Mate: lala, &nd 



. Programs for Formal Review 

Vendors' representatives should feel free to contact task group 
coor41nator listed in enclosure 3, regarding this review proceia. 
However, vendor* • representatives are respectfully requested 
not to contact members afteir January 1, 1979. 



Enclosures 

1. Criteria for Evaluation 

2. DoDDS Arts and Humanities 

Objectives 

3. Formal Review Sites and Task 

Group Coordinators 

4. Introduction to the Materials 

Review Process 




Steve Hptta 
Chief 

Education Division 
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FORMAL RSVtEW SITES AND TASK GROUP COORDINATORS FOR ARTS 



Copies of texts, materlaU, and programs should be submitted for revtev^ 
to the task sroup members located at the formal review sUes Usted below 
only. It wll) not be necessary to provide copies to DoDDS In Alexandrtap 
Virginia, unless a request Is Issued by Hr« Warren Ruppelp Coordinator 
for Arts and Humanities* 



The vendors should note that postal procedures ,^ver$eas do not permit 
personal naoes to appear on official mall,, therefore, letters and parcels 
l(nproperly addressed, according to their standard^ may be returned to the 
vendor unopened* Please coHstruct the address so that the name of the 
task group member does not appear In the address but should be stated In 
the lower left'^hand corner of your mailing label, as appropriate, using 
the following format: 

Office of the Director 

DoD Dependents Schools, E^lrope 

A?0 New York 0916^ 

ATTN: Mr* Jack South, Arts Coordinator 

* * * 

Office of the Director 

DoD Dependents Schools, Pacific 

Futenma, Box JSO 

FPO Seattle 98772 

ATTN: Mr. James McGrath, Arts Coordinator 

* * * ^ 

Principal In Charge 

Lajes Dependents High Schcx^l 

Lajes Field, Azores ^ 
APO New York 09^06 ^ 

ATTN: Mr. John Hewitt, Arts Coordinator 

ic it it 



NOTE: Carbon copies of communications with the Lajes Arts Committee will 
be forwc;rded to the following; 

' Mr. Folmer G* Chrlstensert 

Arts and Humanities Coordinator 
DoO Dep^deiits Schools, Atlantic 
Building 995, Ellyson Field 
Pensacola, Florida 3-509 

(Note for the education coordinators: Future requests for materials 
should reflect updated listings of names and regional addresses.) 

^ J Enclosure 3 



INTRODUCTION 
T 0 

THE MATERIALS REVIEW PROCESS 



I. INTRODUCTION 

All students should have access to Instructional resources appropriate 
to their specific ed-^catlonal needs. In the past, a textbook was not 
available In the teaching of the arts. Instead, there was a set of 
resource roai,ertals available. Changes have been occurring In the form 
of Increased Instructional materials to satisfy Increasing coramUments 
to Individual izat I on of learning. In the area of the humanities teachers 
usually recognize a basic textbook plus supplementary materials or items 
they may produce to round out a program to study humankind. 

Credible sources Indicate that over 300,000 Items of instructional 
materials— books, films, tapes, kits, etc, --are on the market. Th.is is 
more than 30 times the number available 2 cjecades ago. In addition, 
the average student spends about 90 percent of classroom time and some 
homework time Interacting with the instructional materials provided. 
In the humanities, students will spend as much as 75 percent of their 
classroom time and 25 percent of their homework time involved with 
Instructional materials. Instructional materials should be system- 
atically measured against a comprehensiyft list of specific criteria, 
including effect I venesli requirements, prior to their procurement. This 
need for improved Ji^stif I cation of .expend i tu res for instructional mate- 
rials is especially great during these times of reducing resources, 
crij&lcal cdhcerns regarding Instructional effectiveness, and increased 
importance of accountability. 

• Enclosure A 
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2. Formal Review Process 

Personnel from the Atlantic, Europe, and Pactftc, as well as the Office 
of Dependents Schools, are tasked with a responslbl Uty to review major 
disciplinary or Interdisciplinary areas, K«12, as part of the FtvcYear 
Currlculun Development Plan. One Important aspect of that responslhlllty 
will be for each region to conduct a formal reyfteu of essential t^ts, 
materials, and programs during the first year of the review cycle. The 
purpose of such a review Is to determine which new or current materials 
best meet comprehensive criteria established for use within the Department 
of Defense Dependents Schools COoODS) . A list of these texts and materials 
wll I be publ tshed. 

3. Regional Formal Review Committees 

The person representing each region In the subject area of, study Is 
responsible for establishing formal review committees. 

The number of conwlttees established would be dependent upon the number 
of grade levels, courses, essential texts, materials, and programs Identi- 
fied for review. By otlUzIng several committees. Individual committee 
workloads can be reduced and a larger number of locations within the 
regions can be represented. 

Conmlttee membership should include students, parents, and adminis- 
trators as well as teachers. Participation on the part of Interested 
noneducators provides not only additional helpful points of view, but 
also Increases the work potential of the comnlttee. 



ERIC 



The coflwlttee chatrper&tjn should provide appropriate in-service 
training for the membership to ensure effective accompUshment of 
various responsihll Itles. Such training should include practice 
exercises using real Instructional materials of the type to &e re-^ 
vtewied. Throughout the process, all participants should exercise a 
comnltment to objectivity, a recognition of the fact that they represent 
a large number of nonmeiribe rs , and a respect for the Importance of the 
established objectives as criteria for decisionmaking* 

U, Review Criteria 

With an ever- Increasing number of Instructional materials becoming 
available, the formal review procedures must be extended and refined. 
The task force group meeting in August translated specific desired 
characteristics or criteria Into appraisal forms. By incorporating 
modes such as questionnaires, checklists, or rating scales, thoss forms 
ensure the systematic collection, reportage, and analysis of the most 
useful data. The generalized criteria, report forms, and procedures 
suggested below have proved helpful to others. They embrace seven 
categories of data for each item, series, or alternative: 

■(1) Descriptive Data 

(2) Objectives 

C3) Fair and Equal Treatment of 
Minorities and Women 

{k\ Organization of Materials 

CS) Instructional Methods 

(6) Evaluation of Materials 

(7) Evaluation 

134 
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The final rating is arrived at by means of a separate weighting process. 
All items are not of equal Importance within the total score. 

5. Pilot Determintation of Effectiveness Data 

;p^most Important information possible regard I ngul timate adoption 
of instructional materials Is that which identifies the effectiveness 
of those materials in supporting student achievement of ToDDS objec- 
tives. , 

Provision has been made In the formal review process 'or Identifying 

r 

and assessing externally available effectiveness Information. The 
formal review committees may allow such data to outweigh a number of 
other factors, if such Information Is available (aid it rarely is), 

* 

If the number and categories of students are comp.irable, and jf the 
evaluation process is Judged valid. 

Results of the formal review process will be the Identification of a 
limited list of essential texts, materials, and programs that are best 
suitable for use within OoOOS In terms of the criteria established. 
The next important step, prior to regional selection and procurement 
of essential Instructional materials fran the referenced listing, Is to 
pilot applicable essential texts, materials, and programs within the 
region. 

The purpose of such piloting Is to provide Internal effectiveness 
data on the materials considered for fir.al selection and procurement. 
Obviously, the significant advantage of the formal review phase of the 
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seUctloo process Is to reduce the number of materials which should 
be piloted. Thus, with limited resources, a region can generate a 
smaller number, but a higher quality, of pilots to provide the essentia 
effectiveness data required. ^. 

In the limited number of cases where selection and reconroendatlons 
for procurement are made without piloting, those actions should be 
approved by the regional director. 

Since effective piloting of materials Is a complex and demanding 
activity^ separate guidelines are provlded,for DoOOS personnel having 
such responsibilities. 
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DEPARTMENT OF DEFENSE 
OFFICE OF DEPENDENTJ? SCHOOLS 
2461 EISENHOWKR VVEM K 
ALEXANDRIA. VIRCIMA 22331 



EDH-50868 



December 4, 1978 



MEMORANDUM FOR Publisher 

SUBJECT: Systemwide In-Service Training and Price Support 
for Basic Texts and Materials Adoption 

Members of the Science Task Group will meet at headquarters. 
Department of Defense Dependents Schools (DoDDS) , during 
January 22-26, 1979, for the purpose of consolidating 
regional' pilot data and developing a DoDDS worldwide 
science program adoption list. School selection and 
ordering of approved basic texts and materials will begin 
soon after the adoption decisions are made. 

No forecast of the level of program acceptance can be made 
at this time, nor is it possible to say whether single or 
multiple adoptions will be made within a given subdiscipline. 

The Science Task Group has been asked to develop plans for 
in-servic^ training required by the adoption. Your response 
to the following questions will facilitate that planning 
as well as provide valuable information for adoption 
decisionmaking. 

If your materials currently under pilot were to be placed 
on the „adopted list: 

(1) Would your firm sell adopted materials at the 
1978 price for the remainder of the adoption 
period {approximately 4 years)? This would 
mean no price increases, 

(2) Would Teacher's Editions be available at no 
charge? 
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— (3) What in-service help would you be able to provide 

during the following periods: 

School year 1979-1980 (Implementation) 
School year 1980-1981 
School year 1981-1982 
School year 1982-1983 

^ Thank you for your excellent response to requests from our 

regional science coordinato::s for introductory materials 
during the pilot period. 



Steve Motta 
Chief 

Education Division 



cc: Regional Directors 
CDC Members 

Regional Superintendents 
Science Task Group Members 
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